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ABSTRACT 

Addressing the need for a framework to distinguish 
the conditions under which different types of educational computing 
environments are productive, this paper proposes a cognitively based 
Contextual Analysis Framework consisting of two primary elements: (l) 
conceptual characteristics of the knowledge domain being learned, 
including the complexity of the concepts and tasks and the degree of 
orderly and regular conceptual structure of the knowledge domain; and 
(2) stage of learning (novice, advanced) of the learner within the 
knowledge domain. The paper analyzes the characteristics of different 
types of computer-based learning environments (such as computer-based 
drill, intelligent tutoring systems, hypertext) in terms of the 
Contextual Analysis Framework. The paper argues that the failure to 
consider important contextual elements of learning related to 
conceptual characteristics of the domain and the stage of the learner 
could result in otherwise well-designed instructional computing 
technologies being used in inappropriate learning situations. (Eight 
footnotes are included; 40 references are attached.) (RS) 
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Abstract 

The need for a framework to distinguish the conditions under which different types of educational 
computing environments are producUve is addressed, and a cognitive^ based Contextual Analysis 
Framework is proposed that consists of two primary elements: (a) conceptual characteristics of the 
knowledge domah being learned, indudmg the complexity of the concepts and tasks and the degree of 
orderty and regular conceptual struOure of the knowledge domain; and (b) stage of learning (novice, 
advanced) of the learner within the knov^edge domain. The characteristics of different types of 
computer-based learning en^onments (e.g., computer-based drill, intelligent tutoringsystems, hypertext) 
are analyzed in terms d the Contextusd Analysis Fnm&mtk, It is vtgaed that the failure to consider 
important contextual elements of leamuig related to conceptual characteristics of the domain and the 
stage of the learner could result in otherwise well-designed mstructional computing technologies being 
used in inappropriate learning situations. 
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A FRAMEWORK FOR THE CONTEXTUAL ANALYSIS 
OF COMPITTER-BASED LEARNING ENVIRONMENTS 



Compu^jng technologies have been applied to instructional situations for nearly 30 years. Despite this 
fact, the research on the effei^iveness of educational cfNnputing has been somewhat controversial and 
has yielded mixed results (Bangert-Drowns, Kidtk, & Kulik, 198S; Becker, 1988; Clark, 1985; Kulik, 1981, 
198S; Niemiec & Walberg, 1987; Roblyer, Castine» & King, 1988). On the positive side, there have been 
many findmgs of small to moderate academic improvement in certain areas and of positive attitudes 
toward computer-assisted instruction (CAI) in general (Bangert*Drowns et al., 1985; Becker, 1988; 
Kulik, 1981, 1985; Niemiec & Walberg, 1987; Roblyer et aL, 1988). Unfortunately, the quality of some 
of this research has been criticized, and concerns about methodology have been expressed (Bedcer, 1988; 
Clark, 1985; Roblyer et al., 1988). There have also been charges that the educational technology field 
in general has tended to be atheoretical and neglectful oi underfying philosophical issues of central 
import (Maddux, 1988). 

Our primary purpose in this report is to address one fundamental area of theoretical neglect: The need 
for a framework to distinguish the conditions under v^ch di^i^^rent types of educational computing 
environments are productive. Just as there are diCTerent varieties of educational computing systems that 
are qtiite dissimilar from one another, the instruc'.^onal contexts in vMdx computers are employed can 
also differ radically. Learning occurs m a highly comply setting, and an understanding of those 
complexities is necessary if educational computing systems are to be fauly analyzed and appropriately 
employed. We offer a framework for the analysis of instructional computmg systems and of Uieir 
contexts of use. As will be seen, the proposed framework is grounded in cognitive instructional theory. 

We first discuss the components of the Contextual Analysis Framework, then apply the framework to 
representative types of instructional computing systems, with an analysis of contextual conditions that 
are likely to promote or hinder tiie use of each type of system. Finally, we present general 
considerations concerning the utilization of the framework. 

Components of the Contextual Analysis Framework 

The Contextual Analysis Framework consists of two primary elements. The first element delineates 
conceptual characteristics of the knowled^id domain, and includes the complexity of the concepts and tasks 
and the degree of orderfy and regular f xture in the knowledge domain being learned.* The conceptual 
characteristics element is important in that a learning environment suitable for simple and well> 
struaured content areas may be totally ^appropriate for complex and irregularly structured domains 
(Spiro, Vispoel, Schmitz, Samarapungavan, & Boerger, 1987). The second element consists of the 
student's stage of learning within a kno^edge domain and of the associated tasks of learning at different 
stages (Spiro et al., 1987; Spiro, Coulscn, Feltovich, & Anderson, 1988). The analysis of different types 
of computer-based learning envinmments (eg., computer-based drill, intelligent tutoring system, 
hypertext) requires the joint consideration of these two contexraal elements; that is, the contextual 



'We use the term domain in a general way to refer to an identifiable conceptual or task unit of human 
knowledge that can range from quite large (e.g., the entire field of mathematics) to ^uite small (e.g., single digit 
multiplication). 
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elements are interactive in their effects.' We will briefly introduce these two elements, then discuss the 
research on learning failures related to them. 

Conceptual Characteristics of Knowledge Domains 

Well- versus ill-structured knowledge: Dcgite of ordciliBcsi nod regularity. The structure of the 
information, tasks, and kno\i^edge Jomains with vdiich ctxnputer-based leamfaig environments must be 
capable of fimctioning varies enormousfy. There have been many recent discussbns concerning the 
distinction between well- and ill-structured oracepts and problems in the cognitive science literature 
(Spiro et al., 1987; Spiro et al., 1988; Elio & Anderson, 1964; Homa, 1984; Sunon, 1973; Voss, 1987; 
Voss, Greene, Post, & Penner, 1983). Weil-structured content areas (e.g., arithmetic, Newtonian physics) 
possess a regularity in stru^e that typically allows for the identification of general rules or principles, 
hierarchical conceptual relationships, and the use of prototypical exemplars that will closely match a high 
percentage of real-case situations (Sph'o et al, 1987). In contrast, ill-structured domains (e.g., literary 
interpretation, history, biomedidne) are knowled^ areas where many concepts are relevant in a typicsd 
knowledge application case and ^ere the patterns olt use for each concept and concept combination 
varies widely across different case situations. While knowledge areas may therefore be differentiated 
along a contibuum of well- and ill-structuredness, we will see that there are qualitatively different 
instructional unplications depending on Aether learning situations fall closer to one pole or the other. 
It is also important to note that well-structured knowledge must often be applied in ill-structured (real- 
world) situations. For example, well-structured basic sdence components from en^neerhig disdpUnes 
must be applied m real-world case situations that arc frequentiy highly ill-structured. Thus, the 
prevalence of ill-structuredness should not be underestimated. 

Domain and task complexity. There is another important aspect associated witii the conceptual 
characteristics of a knowled^ area: domain con^iadty. More complex concepts may have to be 
understood with reference to several other concepts and they may have many constituent subconcepts. 
Similarly, common tasks that must be performed in a d(Hnain may mvolve few or many steps, branching 
contingencies, ambiguities, and so on. These and the various other dimensions of complenty are 
different concerns than those of domam well-structuredness, which has more to do witii orderlmess and 
regularity in the application of concepts and operations across cases within a domain. 

Domain complexity is correlated with the degree of well- or ill-structuredness in a knowledge area, with 
simple tasks or concepts tending to be well-stru^ured while more complex concepts or domains are 
often ill-structured. The association of domain complexity and stnicturedness is, however, far from 
perfect. While there are few, if any, areas that are both shnple and ill-structured, there are many 
domains that may be characterized as being primarily complex but well-structured in nature (e.g., 
advanced mathematics, physics, physiology). For example, the generalization and rigorous definition of 
mathematical prindples and rules, the strong delineations of task hierarchies in the application of 
mathematical concepts, and the ability of prototypes to apply to all case examples of tiie same type are 
hallmarks of the domain of mathematics. Yet despite its extensive orderliness and regularity (i.e., well- 
structuredness), maUiematical concepts and tasks are often quite complex. It is also interesting to note 
that an area that is largely well-structured at elementary through intermediate-advanced levels frequently 
assumes characteristics of ill-structuredness at the "cutting edge" of the fidd. This is seen, for example. 



^rhere are, of course, other contextual elements that influence the learning environments m which 
instructional computing ^ems must be used, such as individual learner characteristics and social and cultural 
conditi<ms, that will not be addressed in this report. While tiiese are important factors, we view the present 
articulation of tiie framework as a significant first step toward a more suitably elaborate tiieoretical view of tiie 
complexity of this field. 
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in the current research interest in "chaos tbeotf in such fields as mathematics, the natural sciences (see 
Gleick, 1987» for a nontechnical account), and even the sodal sciences (Cziko, 1989). 

Stages of Learning: Introductoiy and Advanced Knowledge Acquisition 

While much recent cognitive literature has described novke/ejqwrt differences (Chi, Glaser, & Farr, 
1988; Glaser, 1984; Vosniadou & Brewer, 1967), the lengthy intermediate stage of learmng between the 
beginner and the ejqpert has received much Ins stud|y. It has been recently proposed that a stage of 
advanced knowledge acquisition or advanced teaming occurs after the introductory stage of learning in 
a subject area and before domain eiqwrtise is achieved after extensive study and experience (Spiro et 
al., 1988). While mtroductory learamg goals typkalOy stress surface familiarity with key concepts that 
are assessed in terms (tf recognition and recall fades, tte goals <^ advanced knowledge acquisition change 
so that the learner must acquire a richer and deeper understanding of the content material. The 
advanced learner must be able to intelUgentfy reason with and to apply flexibly acquired knowledge in 
a wide range of situations that may differ substantiaQy from the conditions of initial learnii^ (i.e., 
knowledge transfer). 

Complexity, lU-Structuredness, and Failure in Advanced Knowledge Acquisition: The 
Importance of Context>Based Adjustment of Learning and Instructional Strategies 

The importance of matching learning and instruction to contextual factors such as those just discussed 
can be illustrated by an examination of recent research that has revealed patterns of extensive defiden<7 
in the learning outcomes of students at the stage of advanced knowledge acquisition, particularly in 
complex and ill-structured content areas (Feltovich, Spiro, & Coulson, 1989; Spiro, Felto^ch, Coulson, 
& Anderson, 1989; Spiro et al., 1987; Spiro et al., 1988).' The failures of advanced learning that have 
been identified are attributable to several converging tendencies on the part of students, teachers, 
textbook writers, teist constructors, and so on. In general, the common denominator across the failures 
is a strong bias toward oversimplification. Among the variety of overshnplifications that have been 
observed to cause learning failure at advanced ^ages are: compartmentalizatim (i.e., slighting the 
intendationships among knowledge components and topics); employment of Sisir^ basis fw knowledge 
representation (e.g., a single analogy, prototype example, oi^-^anization?) scheme, or line of argument); 
emphasis upon the intact retrieval from memory of previouidy learned knowledge (i.e., ri^dly using 
padcets of knowledge in the same way that they were initially learned and stored in memory); and 
oveneliance on abstractions divorced from their contexts of application. In fact, instru^onal approaches 
employing simplifying strategies such as these are often the most successful ones for introducing a 
student to a new subject area. Unfortunately, what helps early in learning often hurts later on (a 
phenomenon that has gone unnoticed because of the previous dearth of studies of the intermediate stage 
of learning between novicehood and expertise) (Feltovich et al., 1989; Spiro et al., 1988; Spiro et al., 
1989). 

Advanced knov^edge acquisition in complex and ill-structured domains requires instructional approaches 
that are often antiUietical to those used in mtroductory leamii^ and that are most appropriate for 
simpler domains (Spiro et al., 1988), such as: webs <^ interrelated knowledge instead of independent 
knowledge rompartments; multiple imowledge representations (e.g., multiple analo^es, precedent cases, 
organizational schemes, lines of argument); assembly of relevant kno\deidge from different conceptual 
and case sources to adaptively fit the needs of new situations; and concepts tied to practice (i.e., 
conceptual knowledge situated in contexts shnilar to those required ui the a[^lication of the knowdedge). 
Such instructional features function as antidotes to the oversimplifying tendencies identified earlier and 



^Of course, as learners reach more advanced levels of attainment in any domain, the importance of dealing 
with the more ill-structured, irregular aspects of knovdedge grows. 
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are vital in cultivating ihzfladble coffiitive npresentatUms that are characteristic of e^rtise and that 
will facilitate the ability of the learner to ap^ esdstuig knowledge to new situations. 

It is important to emphasize that v^en the concepts and phenomena of a domain are simple and 
orderly, the ideal of simplicity m instruction is apprqniate. However, when a domain is complex and 
ill-structured, and ythcn f^c goals of learning require that difficult aspects be mastered, then transporting 
ihe methods that work in simple and regi^ conceptual contexts may have severe deleterious effects 
(Feltovich et al., 1989; Spiro et al., 1988; Spuro et aL, 1989). 

In summary, the example of failure in advanced knovrfedge acquisition illustrates a crucial point: Totaily 
different approaches to teaming instruction, and mental npresetOation are required in well' versus ill' 
structured domains, for simple versus complex eoncqpts, and for the goals of intmductory versus advanced 
learning. The very saiiie approaches diat typically result in successful learning in well-structured 
domains, for simple conceits, and for introductoiy learners, have been found to be unsuccessful in iU- 
structured domains and may actually in^de the acquisition of complex concepts at advanced stages of 
learning m a domun (Feltovich et al., 1989; Sph-o et al., 1989). Furthermore, the approaches that 
appear to be better suited to contexts of irregularity, complexity, and advanced learning are very often 
the opposite of those that most efficient^ produce success in regular, simple, and introdu^oiy contexts. 
Thus, these two contextual factors-conceptual characteristics of the kno«iedge domain (conceptual 
structuredness and complenty) and stage of learning-must be taken mto consideration in the evaluation 
of any approach to learning and instruction, including those that invohre computers. 

Application of tlie Contextual Analysis Framework to 
Computer-Based Learning Environments 

The central assertion of the Contextual Analysis framework may be amply summarized: depending on 
where a teaching situatimt falls within the contextual space of donuUn conceptual characterisdcs and stage 
of learning ^alitativefy d^erent forms ofinstmction must be prescribed. Some of the implications of this 
perspective for the analysis and use of computer-based learning environments are our concern in this 
section of the report. After briefly considerii^ the major types of computer-based learning 
environments commonly employed, we will illustrate the application of the Contextual Analysis 
Framework through a detailed examination of two contrasting instructional computing systems. We will 
conclude this section with a consideration of more global applications of the framework. 

l>pes of Computer-Based Learning Environments 

We use the phrase computer-based leaming envinmments (CBLEs) to refer to both earlier educational 
computing approaches (e.g., computer-assisted instruction and the use of computer tools such as word 
processing) and more recent instructional systems (e.g., mtelligent tutoring i^ems [ITS], microworlds, 
hypertext, and empowering environments). The earlier literature on instructional computing typically 
desaibes three main ways that computers may be employed: (a) a mechanism to deliver instruction 
(e.g., computer-assisted bstruction [CAI] ^)proaches such as tutorials, computer-based drills, and 
simulations); (b) a tool that students may use to accomplish a variety of tasks (eg., word processing, 
spreadsheets, data bases); and (c) a device that may be programmed by students to accomplish new 
computer-based tasks or for general problem-solving eicperience (Bork, 1985; Dennis & Kansky, 1984; 
Taylor, 1980). Most of the research on the effectiveness of computers in education has focused on these 
types of CBLEs (Bangert-Drowns et aL, 1985; Becker, 1988; Clark, 1985; Kulik, 1981, 1985; Niemiec & 
Walberg, 1987; Roblyer et al., 1988). 

Other recent approaches to usug computers in instruction have attempted to utilize research into 
cognitive processes to more closely simulate the teaching of a human tutCH- by a computer system or to 
establish computer-based learning systems that provide some type of cognitive support for the learner 
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(Brown, 1985; Collins & Brown, 1988, Dede^ 1987, 1988; Sleeman & Brown, 1982; Wenger, 1987). 
Intelligent tutoring systems (ITS), for example, attempt to ^mderstand** the content and the student's 
progress, thus fadUtating the individualizaticm of bstructton (Dede, 1987, 1988). Other contemporary 
CBLEs, for example, hypertext (Dede, 1987; Conldin, 1987; Jonassen, 1986), microworlds (Dede, 1987, 
1988; Papert, 1980), and empowering environments OSrown, 1965; Collins & Brown, 1988; Dede, 1987, 
1988), are designed to function m partnership with die student w teacher. The latter CBLEs attempt 
to provide a synergistic comlnn^on the cognitive strengths of humans for processing rich, 
interconnected knovrfedge and the computer's large shwt-term and long-term memory capabilities and 
strength in the rapid execution of complex a|g<NriUmis and qmfad manipulation (Dede, 1988). 

Applying the Anatytical Framework: A Detailed Anatysis of Two Representative 
Computer-Based Learning Environments 

The Contextual Analysis Framework we are {nropodng sug^sts that different types of CBLEs are better 
suited to different learning contexts. The framework guides the selection of an appropriate CBLE to 
promote learning in the target mstructional ^tuation as a fanctu)n of the conceptual diaracteristics of 
the kno^edge area (domain structuredness and complenty) and the student's stage of learning. For 
example, because of distinctive cognitive design characteristics, certain types of CBLEs are regarded as 
being most applicable to shnple and well-structured content areas or to introductory learning situations 
(e.g., CAI tutorials appropriate for ^ple and well-structured domains, but not for complex and ill- 
structured knowledge), while other systems are analyzed as having their migor applicability at the 
advanced stage of learning and in domains with higher levels of complesdty and concej^ual ill- 
structuredness (e.g., mstructional hypertext systems). To demonstrate the application of the Contextual 
Analysis Framework, we will first provide a detailed examination of two contrasting educational 
computing approaches: a computer-based drill and a hypertext leammg environment. 

Computer-based drill systems. There are several factors that may be considered when analyzing the 
contextual elements associated with a hyp(rthetical computer-based drill program. Let us take, as an 
example, a typical use of a computer-based drill that involves a student learning the multiplication table. 
Ki'st, a learner of this type of information is usually hi the middle elementary grades and is thus at an 
intfoductofy stage of learning with respect to mathematical kno^edge. Student learning of the 
multiplication table is typicalfy assessed m terms of tasks that require the accurate retrieval from 
memory of the pre^oudy learned kno^edge (e.g., "7 x 8 56"), a practice that is consistent with 
introductory stage learning goals discussed earlier. Notice that the universe of all pos^ble mathematical 
knowledge relevant to multiplication has been greatfy stmpi^d^ with more advanced mathematical 
03ncepts such as set theory or the algebraic formulatton of multiplication not being expUdtly included 
ui the instructional activities commonly associated with merely memorizing the multiplicaticm table. 
Here we are concerned only with the latter task. 

Second, the conceptual chamcteHstics of the basic multiplication table are orderly and relatively simple. 
The well-structured nature of this domain is reflected m the existence of orderly and consistent patterns 
(e.g., 2 X 1, 2 x2, 2 X 3), and there is a high degree of conceptual regularity in that the same principles 
apply to all pertinent examples (e.g^ learning an instructional example of "2 times 3 apples equals 6 
apples" easily transfers to a new situation requhing the determuiation of **2 times 3 elephants"). The 
conceptual complexity of this domain is reasonabfy sunple (compared, for example, to quadratic 
equations), cons^ting of such elementary arithmetic concej^ as basic attributes of numbers, ample 
arithmetic symbols (e.g., digits, "x", "«"), and so on. 

Ftom the perspective of the Contextual Analysis Framework, there are several common design 
characteristics of computer-based drill programs that seem appropriate for learning the "multiplication 
table domam." Computer-ba: 4 drill systems tend to present the instructional material k a simple 
manner that is suitable for this type of content and stage of learning. For example, a sin^ knowle4ge 
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representation (a stimulus such as "What is 7 x 8?" is employed to elidt a specific response: "56"). The 
multiplication knowledge is drilled b a manner abstracted from appUcadon settings^ which shields the 
learner from having the additional cognitiv6 demands associated with a complex problem solving 
situation with potentially distracting mformation unrelated to the task of multiplying numbers. In terms 
of promoting the goals of introduct(»y stage learning, c<miputer>based drill designs help fadlitate the 
memorization of the material by pro^dmg CMoentrated practice with unmediate feedback to the learner 
in terms of the correctness of the response, and mxac sophisticated designs may monitor the patterns 
of the correct and incorrect responses to provide the leanier with more practice on difficult items.^ 

Given this analysis based on the Contextual Analyas Framework (and with the caveat that we do not 
recommend computer-based drill programs as the sole instructional methodology for teaching the 
multiplication table domain), we suggest that computer-based drill programs have several features (e.g., 
simplified representation of multiplication knowledge, feedback on single correct answers, emphasis on 
factual recall) that are appropriate for {womotug introductoiy stage learning in a simple and well- 
structured knowledge domain of this type. 

Instructional hypertext and hypermedia systems. In this section we consider the contextual elements 
associated with advanced learning in a complex and ill-structured domain: interpretive comprehension 
of the classic literary fihn Citizen Kane. While the elements of the Contextual Analysis Framework 
assodated with this dnematic/literary domain differ sharply from those of the multiplication table 
domain described in the computer-based drill example, we will show that there is an apt fit between 
these contextual features and the characteristics associated -Mth hypertext learning environments. The 
CBLE we will discuss is a hypertext system (Spiro & Jehng, 1990) derived from a cognitive theory of 
teaming for transfer in complex and ill-structured domains (Spiro et aL, 1987; Spiro et al., 1988). 

First, with respect to sUtge of leanings the intended use of the hypertext system is for advanced learners: 
college students (or select high school students) vidio have acquired a general awareness of the film 
during a period of introductory learning (typically indudmg one or two complete viewings of the fihn), 
and who are now e)q>ected to demonstrate learning that goes beyond reproductive memory for 
superfidal information about the film. They are e]q)ected to evince more sophisticated understandings 
of the complex structure of the film and to be able to independently address relevant new questions for 
which they have not received direct mstrudion (i.e., transfer of learning is expected). 

Second, with respect to the cmtceptual characteristics of Citizen Kane^ it is dear that the fihn is quite 
complex and ill-structured. This is reflected in the numerous aspects of the fihn discussed in the critical 
literature (e.g., pl(rt, characterization, dnematic techniques). Many aspects of complexity and cor..«ptual 
irregularity are revealed m considerations of a central component of the film: Kane's behavior, 
motivations, problems, and so on.^ Different experts have proposed a number of themes as providing 
a complete description of Kane's behavior, such as: "Hollow Man" (the soullessness of Kane), "Wealth 
Corrupts," and "Outsized Ambition." While these themes do partially overlap, each theme makes a 
novel contribution toward understandmg the Kane character that is not found m the other themes-there 
is CO smgle "main theme" that is best for capturing the nature of Kane and accountug for Uis behavior. 
At different points in the fihn different themes are relatively ascendant-all themes do not equally aj^ly 
to all scenes in the movie (e.g., certain themes may be strongly relevant to some scenes but not to 
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^No claim is made that sterile memorization of multiplication tables is the best first step toward preparing 
learners to apply multiplication facts to real problems. In fact, our earlier argument suggests just the opposite: 
The early simplification may impede the learner in building toward more complex understandings. Howeveri 
if all you want to do is memorize the multiplication tables^ computer-based drill systems are appropriate. 

^his type of analysis could be profitably extended to mdude additional aspects of the fihn. 
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others). Not only are multiple themes necessaiy for understanding Kane across the fUm as a whole, but 
any shigle point in the film is likely to require amdysis in terms of interactive combmations of more than 
one theme. Furthermore, each Uieme is noC used in exactly the same way at every point in the fUm 
where it is relevant. Rather, the different uses (instantiations) of each theme are related to each other 
only by a rough family resemblance (instead of by a set of defining features). 

We have presented just a few illustrations of the featui^ d complexity and ill-structuredness that are 
confronted in tsying to achieve an advanced understanding (tf the Kane character. However, it should 
be clear even from this brief presentation that the structural characteristics of this knowle(^ domain 
(e.g., the large number of pertment conceptual structures and the fact that they bteract m combination 
with each other) make the attamment <ji the goals cS advanced stage learning quite difficult compared 
to simpler and more orderly domauis. Nonlinear and multidimenuonal hypertext systems are especially 
well matched to the histructional context of advanced mastery of complex and ill*stnictured material. 
We will next highlight an approach to structuring a hypertext learning environment that has been 
specially designed to address these features of conpleidty (including many not mentioned here) that 
present such great trouble for advanced learners (Spiro et aL, 1988). 

A prototype instructional hypertext system has been developed to provide advanced stage learning of 
the aspects of this fihn associated with the Kane character (Spiro & Jehng, 1990). While only a portion 
of the movie has been analyzed and bcorporated into this mstructional hypertext program to date (25 
scen^ lastmg a total of about 30 mmutes from side two of the Gtizen Kane videodisc [Welles & Stein, 
1984]), this material constitutes a rich instructional knowledge base the learner may study. Some of the 
complex conceptual structure of the movie is represented by the inclusion of 10 miyor themes found in 
the critical literature on the fihn, each of ^ch could be argued to be the most important one for 
understanding the Kane character.' The 25 scenes selected for instruction are treated as self-contamed 
"minicases," each of which is analyzed from the perspectives of a subset of the 10 m^jor themes relevant 
to that scene, as they interact m any combuiation. Muiicase*spedfic thematic commentaries relate the 
more general and abstract nature of each theme to the particular scene being viewed. Not only can the 
film be viewed with each of the scenes beuig shown and studied in detail in a sequential manner, but 
the fihn may also be re-edited by the program to allow the learner to select a particular theme (or 
combmation of themes) of mterest and to view only those scenes in which the selected theme (or 
themes) applies. For example, suppose a learner is interested in the relationship of the "Hollow Man" 
and the "Power Corrupts" themes. The program would allow the hypertext link structure to be arranged 
so that the learner would view only those minicase scenes that contam both of these themes (and to read 
the {^sodated thematic commentaries tailoring the themes to the particular scenes). When scenes are 
>dewed out of their original sequence, stage-settmg background information can be requested. There 
are also program options for learners to create their own ^ctural schemes m addition to using the 
preprogrammed options.' 

Even with this cursory description of the Kane hypertext, it is possible to illustrate several features that 
make it an appropriate computer learning environment for its instructional context (i.e., advanced stage 



^ote that while the exact number of themes employed is not critical, it is important that several themes be 
employed and that these themes have a fahrly wide coverage in the domain. In an ill-structured domain, nearly 
all themes have some degree of "correctness" (but only to a Umited extent) and the irregularity of the conceptual 
structure is best revealed by multiple perspectives (such as the multiple themes and scene units/minicases 
employed in this program [Spiro & Jehng, 1990]). 

^e hypertext under discussion is just one of several hypertext prototypes developed by Spiro and his 
colleagues. Each of thn systems is generated from the same rich core set of principles. The interested reader 
will find more extended explications of the approach in Spiro et aL (1988) and Spiro and Jehng (1990). 
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learning goals for a complex and iU>stru^ured knowledgr dumain). For example, the complexity of the 
film cannot be understood from any single perspective, which wcnild have to be inadequate because of 
the fika's ill-stru^ed nature. The hypertext program allows the learner to view the film from muitipie 
Utematie perspectives^ each of wide application. This also facilitates transfer by increasing coverage 
within the domain: If knowlec^e has to be used in many ways, as it ^ in an ill*structured domain (by 
definition), it should be learned and mentalfy represented in many ways. 

Where there is a problem m ill-structured domains because generic or abstracted concepts miss too 
many specifics of particular applications of a concept, the case-centered approach of this program 
provides situated emceptual knowkdgfi in the context tsi scenes from the fihn. For example, the 
conceptual thematic information (presented m the auxiliary commentaries) is "tailored" to its context of 
application (helping to prepare the learner similarly to adqiC abstract conceptual information to concrete 
cases). The learner develops an understanding of the abstract themes that is situated m the actual 
context of application of this knowledge (e.g., the actual scenes from the film itself), thus avoiding the 
tendency toward simplification that may result from absti acting the knowledge away from the situations 
and conditions of use (as would tend to occur if the learner were to read the abstract thematic 
descriptions without being able to view appropriate segments of the fihn itself). 

The program's theme search feature addresses a related problem of irregular domain structure, 
conceptual variability of opplicaHon. The theme search feature allows the learner to see a series of 
scenes from the fihn each of \^ch is an illustration o.' the given theme. In an ill-structured domain the 
same nominal concept takes different forms on dififerent occasions; by enabling the leamei to see a 
chronolo^cally nonadjacent series of these varying uses of the same concept sequentially, attention is 
drawn to the nature of the variability m that conceptual thf.me's usage. Ag^in, if knowledge has to be 
used in many ways, as it will in an ill-structured domairi, it !^Jiould be learned m many ways. 

Furthermore, learning difficulties are caused by the fact that different combinations of conceptual 
structures tend to be relevant at any one tune, and the meaning of each concept is affected by the others 
with which it co-occurs. This aspect of complexity is addressed by allowing the learner to explore (with 
more or less explidt guidance) any possible combmation of the concepts: A configuration of concepts 
is requested and scenes from the film that exemplify that combination are shown m sequence. 

In this manner, interconnected webs of knov^edge are built that are far more accurate representations 
of the complexity of the domain than compartmentalized understanding would be. Relatedly, the 
problem of transfer is compounded by the fact that m ill-structured domains such as this one, new uses 
of knowledge require assemblies of conceptual knov^edge that can take many forms and can not be 
anticipated m advance. Cross-references to other parts of the knowledge space that are encountered 
when mteracting with the program establish routes of mterconnection for future knowledge assembly 
while at the same time unplidtly modelmg the mterconneaed nature of the knowledge and thus the 
assembly process itself. 

Thus it can be seen that the features of tHs hypertext learning environment are quite tailored, on many 
different dimensions, to the needs of advanced stage acquisition of complex and ill-structured knov^edge. 
In a variety of ways, the complenty of the domain is 'covered' and learners are prepared to use their 
acquired knowledge in an adaptive^ flexible manner. Again, there are many ^er features of this 
approach to structuring an mstructional hypertext that illustrate its fit as a CBLE for a complex and ill- 
structured educational context that are consistent with our proposed Contextual Analysis Framework 
(see Spiro & Jehng, 1990 for a more complete discussion). 

Inappropriate uses of computer4>ased drill and Instructional hypertext approaches. In the previous 
two sections, we have stressed the^ between two specific types of CBLE and critical compoueats of 
their respective contexts of use, m terms of the Contextual Analysis Framework. We wiU now consider 
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the consequences sAicn the opposite situation holds: an inappropriate use of a specific CBLE for a 
particular contextual configuration of laxvtAtdgfi structure complisxity/ill-structuredness and stage of 
learning. We will examine this issue through a further consideration of computer-based drill and 
instructional hypertext systems. 

Depicting the web-like interrelationships of the large number of relevant concepts in complex knowledge 
areas seems ill-suited for instructional delivery usmg computer-based drill designs, and indeed it would 
be difficult if not impossible for the student to be drilled on all the relevant concepts and possible 
conceptual and kno\i^edge application interactions in such domains (^ch often involves applying 
acquired kno^sdge in new situatrans that could not be fmeseen in the original instructional treatment). 
Furthermore, the ability to accurately retrieve memorized information is only of limited utility in an ill- 
structured domain where previously teamed matwial may not exactly apply to a new situation (or mi^ 
only apply g^n certain constraints and conditicms, hence the need to stress the assembfy of relevant 
knov^edge). Indeed, one of the primary advantages of the computer-based drill approach for 
introductory stage learning-providing immediate fee^NKk concerning the correctness of the student's 
response-is difficult or impos^ble to implement at an advanced stage of learning in a highly complex 
and ill-structured area because there is often no sbgle correct answer upon ^ch even domain e]q;)erts 
can agree (Voss, 1987; Voss et al., 19S3). This would certainty be the case for the GHzen Kane 
ihematic interpretation domain discussed earlier (although a computer-based drill to promote factual 
memory for the details of the fihn m^t be appropriate if the instructional context involves students at 
a more introductory stage of learning). 

In a sense, computer-based drill programs are not appropriate fcr advanced stage learning in complex 
and ill-structured content areas precisely because of the dose match (discussed above) between typical 
computer-based drill design features and the learning requhremenUi of introductory stage leammg in 
simple and well-structured domains. As Spiro and his associates have shown (Feltovi^ et al, 1989; 
Spiro et al., 1987, Spiro et al., 1988) the learning conditions for introductory stage learning versus 
advanced stage learning are quite contrasting along a number of dimensions. Computer-based drill 
programs, as discussed earlier, are effeOive for introductory leammg situations primarily because of 
several design characteristics that simpRfy the knowledge for the leamer. Computer-based driU 
programs, we therefore argue, are inherently limited in their ability to provide an appropriate 
instructional environment for complex and ill-structured content, and may in fact be hannfiil if 
inappropriately applied in such domains (Feltovich et al., 1989; Spiro et al, 1987). 

We stress that the instmctional features of computer-based drill programs are not 1>ad'' per se, but 
rather are appropriate for a certain dass of contextual learning situations: those of mtroductory stage 
learning in simple and well-stractured areas. It is hiterestuig to note that historical trends assodated 
with computer-based drill software are largely consistent with the Contextual Analysis Framework in 
three main ways: (a) extensive use of these programs at introductory learning levels and in relatively 
simple and well-stractured areas (e.g., mastering arithmetic tables or basic language arts skills); (b) 
effectiveness of these programs in introductory/well-^ractured content areas (e.g., Bedcer, 1988; Ro^lyer 
et al., 1988); and (c) avoidance of these designs in more comply and ill-structured areas. 

On the other hand, it seems obvious that a complex nonlinear and multidimensional instructional 
hypertext program of the sort discussed above would be inappropriate for beginning learners in many 
situations, induding helping children to memorize multiplication tables. More complex learning 
environments have their costs, both for developers and leamers. Regarding the latter, the complexity 
of structure frequently embodied in the design of instradional l^pertext programs could be 
inappiopriate for a novice m a simpler domain such as learning the multiplication table. There is a 
dagger of cognitive disorientation when using hypertexts (e.g., being lost m a cascading web of hypertext 
links and nodes (Beeman et al., 1987; Chamey, 1987; Conklln, 1987; Jonassen, 1986; Smith, Weiss, & 
Ferguson, 1987). In general, the fleidbility and nonlinearity of instmctional hypertext systems that is so 
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attractive for advanced stage learning tttualMws may impose extensive cognitive and metacognitive 
demands on the learner that are unraJistic to eiqpect at an introductory level, demands that could 
frustrate novice students and inhibit learning. While it is important that a CBLE be as challen^ng as 
the learning situation requires, these systems should not be mon complex and difficult than necessary. 

In summary, we have suggested that the same CBLE can be effective in one instructional context and 
ineffective in a different context, ^Mc a seccmd CBI£ could have the exact opposite pattern of fit to 
instructional context. It is important that dedgners and educatCMrs anafyze the instructional situation and 
that CBLEs be selected that are appropriate for critical kno^edge domam conceptual cuaracteristics 
and the stage of learning attained 1^ the student 

Utilizing the Ana^ical Framework 

The proposed Contextual Analysis Framework may be used to enrich the understanding of current 
practices and research findings (le., an interpretive Kincticm) and to guide future use, development, and 
research in the field (i.e., a prescriptive function). In the next two sections, we provide some examples 
of these types of interpretive and prescriptive applicaticms of the Contextual Analysis Framework* 

Interpretive api^tcatlras. The Contextual Analysis Framework may be used to provide a perspective 
from which to analyze findings from the instructional computii^ research literature. For example, a 
problematic example from the literature omcems on inverse reMonslup between ffode level and the 
effectiveness of CAI (reported by several researchers [Bangert-Drowns et al., 1985; Becker, 1988; Kulik, 
1981; Niemiec & Walberg, 1987], but not found by Roblyer et al., 1988). This inconsistency in the 
effectiveness of CAI across different grade levels has not been rigorously es^lained in the literature. 
Roblyer and associates suggest that the effectiveness/grade level inconsistency may be only a 
characteristic of the older literature on the effectiveness of mainframe«based CAI programs. However, 
Becker's recent and largely microcomputer'^riented meta-analysis of the effectiveness of long term CAI 
studies (grades K-12, eight weeks or longer) also found an inverse effectiveness/grade level relationship 
(Becker, 1988). 

This controversy may be e3q>lained, however, from the perspective of the Contextual Analysis 
Framework. As a general curricular observation, lower grade levels provide introductory instruction and 
cover more well-structured aspects of a domain. In contrast, higher grade levels typically reflect 
instruction at more advanced levels and deal with more complex and ill-stru^ured facets of a content 
area (although note that simplifying instructional techniques may be found to some degree at all 
educational levels (Spiro et al., 1987). As discussed above, CAI approaches (in particular, tutorials and 
computer-based drill) have cognitive design characteristics that are well*matched to introductory learning 
and simple/well-structured content areas. It is thus consistent with the Contextual Analysis Framework 
that CAI would be more effective at lower grade levels, wbidi generally have an introductory and well* 
structured focus, than at higher grades that require the achievement of advanced stage learning goals 
in more complex knowle<^e areas. We suggest that future meta-ana^c studies examining the 
effectiveness of CBLEs could benefit from the txpHdt consideration of conceptual characteristics of the 
knoi^edge domaui and stage of learning level described by the Contextual Analysis Framework. 

This example illustrates an interpretive application of the theoretical apparatus associated with the 
Contextual Analysis Framework. But while mterpretive applications are important, the framework 
should also be of value for many de^gners and educators in terms oi helping to guide the development 
and use CBLEs, a topic we address in the next section. 

Pk*escriptlve appltcatlims. The Contextual Analysis Framework should be of particular use in predicting 
the viability of different CBLEs for various learmng situations. We will briefly consider two scenarios 
describing the use of the Contextual Analyius Framework in this manner. 
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Fintt suppose a courseware developer is interested b devek^ing CBLEs for coUege>level courses in 
several content areas such as electronics, "C piogramming, and literary interpretation. Using the 
Contextual Anafysis Framework, the devek^ wmild junine the comple^dty and structure of the 
instructional domains and the stage of learning the students. Both the electronics and programming 
courses are in complex but reasonabty well*8tructured areas and the developer expects some overlap of 
introductory and advanced stage learning as well The selectkm of an ITS for domains with these 
characteristics and for both introductory and advanced stage learning would be considered appropriate 
from the perspe^ve of the Contextual Ana^sis Framework. The area of literary interpretation, 
however, is a complex and highly ill-structured domam requiring an extensive background in literature, 
and therefore needs students at an advanced stage of leamiug in this field. As discussed above, a 
hypertext leamhig environment may be successfi% used hi a ccMnplex and ill-structured domain such 
as literary interpretation, while an FTS would probably not be i^opriate (because of the strengths of 
artificial intelligence In dealing with "roufinized" knov^edge). 

A second scenario illustrating the prescriptive use of the Contntual Analysis ^amework involves 
educators in contrasting subject areas and educational levels ^o are evaluaUng different types of 
CBLEs. A college hi^ory teacher, for example, would typically be mvolved with teaching complex and 
ill-structured knoi^edge and therefore would little benefit from an eiqwnsive litwary of tutorial and 
computer-based diill software that is mainfy applicable in simpler and more well-structured areas. The 
use of sophisticated historical and social science Emulations and hypertext learning envlronmentS'-ideally 
consisting of a large multunedia Imo^edge-base" of text sources, bteractive videodisc or digitized video 
materials, high resolution graphics, and sound-would be more appropriate for such a oratent area, as 
would the use of tool software sudi as word processing for paper writing. 

A sdence educator at the middle or high school levels, on the other hand, could reasonably employ 
tutorial or computer-based drill programs for certahi introductcny facets of a well-structured science 
topic (e.g., acquiring basic termmology and fundamental concepts). At more advanced learning and 
complesty levels, the teacher could use sdence sunulations (which Roblyer et al., 1988, found to be 
particularly effective) and tool software/empowering en<rironments for stati^ical analysis, writing, and 
even telecommunications (e.g., for sharing knoD^edge with student colleagues on national and 
international educational networks [Levin, Riel, Miyake, & Cohen, 19871). 

Flexible use of the Contextual Analysb fVamework for assembling ensembles of computer4)ased 
learning environments. The framework may be applied to a wide range of instructional situations and 
types of instructional computing systems. However, we would stress that the framework is not btended 
to be a ri^d taxonomy. Rather, the Contextual Amlysis Framework should be used m difladble manner 
to help determine the most appropriate learning dtuations in which to use a gn«n type of CBLE. 
Indeed, the framework maybe regarded as a theory-based assentbfy guide for CBLEs in sAddx dififbrent 
types of systems are selected accordhig to imp(Htant contextual learmng factors and then used in 
combmation. In other words, the framework could be used in selecting and sequencing multiple and 
complementmy systems as part of an instructicmal ensemble. Different CBLEs in a particular ensemble 
would be used for different instructional purposes. In any knowledge domain, there is very crften a mix 
of both simple, orderly, well-structured elements and complex, irregular, ill-structured aspects. Similarly, 
the learner will be at an introductory level with respect to some aspects of the instructional situatbn and 
at more advanced levels for others. Consider, fcH* example, a course in cardiovascular medicine. Some 
of the technical vocabulary may have quite regukr usa^ patterns and thus may merely need to be 
memorized. A coif^er^e^f d>i// might be used for this aspect of instruction. Other aspects of the 
course will be very complex but regular. For examj^ conceirtual understanding of muscle fiber 
physiology invokes a variety of interaduog amcepts and is therefore quite complex; however, the same 
complex processes happen in the same way fw each of millions ci muscle fibers. The Contextual 
Analysis Framework would suggest that intelligent tutorit^ systems have a special appropriateness for 
advanced learning of complex but regular conceptual material of this type (see Sleeman & Brown, 1982; 
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Wenger, 1987). On the other hand, a hypertext learning environment like the kind discussed earlier 
would be most appropriate for developing flexible conceptual knowledge struc^es requhred for the 
highly ill-structured task of extendbig basic biomedical concepts to clinical cases of cardiovascular 
pathology* 

Conclusion 

This report has proposed an analytical firamewwk fw understanding unportant contextual elements 
associated with learning that may contribute to the success or failure of different classes of 
computer-based learmng environments. While not intended to function as an expVicat model for the 
pedago^cal design of specific types of computer-based learning environments, the Contextual Analysis 
Framework does identify two critical elements related to learmng-the chara^eristics of the knowledge 
domain associated with conceptual structure and the stage oi leamhig--that any comprehend theory 
for the mstructional computing field must successfully address. Once a particular computer-based 
learning environment has been chosen, the spec^ design parameters must be carefully based on the 
best theoretical and instructional de^ models that are available. However, it is important that 
researchers, designers, and educators confront *fint questions first" in their attempt to explore and 
utilize computer-based learmng environments in educationally robust ways. The failure to consider 
important contextual elements of leamhig related to domun complexity, regularity of structure, and the 
stag? of the learner could result in otherwi e well-designed histructional computing technolo^es being 
used in mappropriate ways. We view the present articulation of the Contextual Analysis Framework as 
an initial step toward addressing these "first questions." 



%i fact, a hypertext prototype based on the same theoretical principles as the Citizen Kane program has been 
developed for exactly this purpose: the Cardiowoiid Explorer (Spiro et al, 1988). 
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